High-quality light field interpolation in epipolar plane image domain by DCT-based shearing
نویسندگان
چکیده
Light field (LF) is a 4-D function representing the light radiance in free space in terms of rays. A dense grid of cameras, parameterized by two planes, captures an LF: the sensor plane and the focal plane. Multi-camera images stack in volumes, and when sliced, form epipolar plane images (EPI). In EPI, lines with the same slope represent object points at the same scene depth. Thus, the synthesis of new views can be formulated as a problem of interpolation in EPI domain. In this contribution, we propose a three-pass algorithm for LF interpolation in EPI domain. Each EPI is sheared by a factor determined by the dominant slope, employing fast DCT-based fractional shifts. In sheared EPI, dominant lines appear vertical and can be easily interpolated. ‘De-shearing’ reconstructs EPI’s original geometry. We analyze the performance of the proposed LF interpolation in Fourier domain and illustrate it with examples of virtual view synthesis from dense multicamera imagery.
منابع مشابه
Multi-Focus Image Fusion in DCT Domain using Variance and Energy of Laplacian and Correlation Coefficient for Visual Sensor Networks
The purpose of multi-focus image fusion is gathering the essential information and the focused parts from the input multi-focus images into a single image. These multi-focus images are captured with different depths of focus of cameras. A lot of multi-focus image fusion techniques have been introduced using considering the focus measurement in the spatial domain. However, the multi-focus image ...
متن کاملConsistent Matting for Light Field Images
We present a new image matting algorithm to extract consistent alpha mattes across sub-images of a light field image. Instead of matting each sub-image individually, our approach utilizes the epipolar plane image (EPI) to construct comprehensive foreground and background sample sets across the sub-images without missing a true sample. The sample sets represent all color variation of foreground ...
متن کاملArtifact reduction techniques in Cone Beam Computed Tomography (CBCT) imaging modality
Introduction: Cone beam computed tomography (CBCT) was introduced and became more common based on its low cost, fast image procedure rate and low radiation dose compared to CT. This imaging modality improved diagnostic and treatment-planning procedures by providing three-dimensional information with greatly reduced level of radiation dose compared to 2D dental imaging modalitie...
متن کاملDatasets and Benchmarks for Densely Sampled 4D Light Fields
We present a new benchmark database to compare and evaluate existing and upcoming algorithms which are tailored to light field processing. The data is characterised by a dense sampling of the light fields, which best fits current plenoptic cameras and is a characteristic property not found in current multi-view stereo benchmarks. It allows to treat the disparity space as a continuous space, and...
متن کاملA Novel Ray-Space based View Generation Algorithm via Radon Transform
Ray-space interpolation is one of the key technologies to generate virtual viewpoint images, typically in epipolar plane images (EPI), to realize free viewpoint television (FTV). In this paper, a novel Radon transform based ray-space interpolation algorithm (RTI) is proposed to generate virtual viewpoint images in the EPI. In the proposed RTI, feature points of each EPI are first extracted to f...
متن کامل